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The  AM  IT  program  is  an  advanced  research  (6.3)  program  developed  as 
a  human  performance  enhancement  for  flightline  maintenance 
technicians  in  the  operational  and  warfighting  environment. 


The  need  for  AMIT  was  identified  as  critical  to  reducing  persistent 
“Cannot  Duplicate”,  “Re-test  OK”  and  false  removal  patterns  that  have 
hampered  maintenance  performance  and  readiness  and  have  increased 
operating  costs. 


The  significance  of  AMIT  will  be  in  researching  the  troubleshooting 
process  and  cognitive  demands  and  decision  points  in  order  to  identify 
the  gaps  where  emerging  science  and  technology  could  be  applied  to 
improve  performance. 


Presentation  Outline 


•  Description  of  AMIT 

•  Method 

*  Results 

*  Application  of  Results 


Aircraft  Maintenance  intuitive  Troubleshooting 
(AMIT)  Program  Description 


•  Three  year  Air  Force  Research  Laboratory  Proof  of  Concept 
Demonstration 


*  Project  Goal:  Reduce  aircraft  downtime  by  improving  human 
performance  in  maintenance  troubleshooting  of  complex 
aircraft  system  discrepancies 


Project  Objectives: 

—  Novice  perform  at  or  near  expert  level 


—  Expert  demonstrates  improvement 

Novice  Knowledge  Base 


Expert  Knowledge  Base 


Logbooks 


Other 


Tech 

Reps 


AFETS 


Fault  Isolation 


Training 


Schematics 


Advanced 

Training 
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Goal:  Capture  and  reuse  expert  knowledge  and  strategies 
Specific  Objectives: 

—  Evaluate  contextual  filtering  of  knowledge 

—  Evaluate  efficient  information  on  demand 

—  Evaluate  knowledge-centric  approach  using  an  intelligent  broker 

—  Quantify  the  effects  of  cognitive  job  aiding 


Baseline  of  expert’s  knowledge,  thought  processes,  and  goals 
(Chipman,  Schraagen,  &  Shalin,  2000) 

Goals  of  AMIT  CTA  effort: 

—  Goal  #1 :  Corroborate  maintenance  process  with  Process 
Interviews. 

—  Goal  #2:  Identify  cognitively  complex  areas  of  maintenance. 

—  Goal  #3:  Define  Expert  vs.  Novice  Differences 


•  Pre-test 

—  Validate  that  our  CTA  technique  gathered  the  intended 
information 

—  Subject  pool  consisted  of  aircraft  maintenance  personnel  with 
equivalent  expertise  to  our  intended  subject  pool 

—  Performed  locally  at  Springfield  ANG,  OH 

•  Full  Test:  Three  sets  of  interviews 

-  Nellis  AFB,  NV 

-  Hurlburt  Field,  FL 

-  Eglin  AFB,  FL 

—  Subject  Pool  cuts  across  bases  and  specialties 


Method 

CTA  Interview  Process 


to 


Task  Diagram 

—  Identify  primary  steps  in  fixing  an  aircraft 

—  Identify  steps  requiring  difficult  decisions,  expert  knowledge 
Knowledge  Audit 

—  Cues  that  the  maintainer  notices, 

—  Strategies  employed  to  effectively  perform  maintenance, 

—  Problems  that  might  be  difficult  for  a  novice  to  navigate. 

“Ideal  World” 

—  Outside  the  box  concepts 

—  Look  for  themes  (e.g.,  communication,  information  archiving,  fleet 
wide  data) 


Confirmed:  Task  Diagram  is  consistent  across  aircraft  bases  and 
across  specialties. 


General  Design  Implications 


*  Graphical  System  Representations. 

—  Connections  to  other  systems. 

—  Help  maintainer  build  a  mental  model. 

*  Electronic  TOs. 

—  Information  integration 

*  Electronic  Wiring  Diagrams. 

—  Wiring  Diagrams  /  Tech  Order  link 

*  Access  to  Other  Information  Sources. 

—  Promote  collaboration 
—  Information  push  to  novice 
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Specific  Prototype  Applications 


*  A  Ul  framework  to  orient  the  user 

—  Connections  to  other  systems. 

—  Help  maintainer  build  a  mental  model. 

*  Support  work  beyond  the  TO 

—  Information  integration 

*  Electronic  Wiring  Diagrams 

—  Wiring  Diagrams /Tech  Order  link 

*  Access  to  Other  information  Sources 

—  Promote  collaboration 
—  Information  push  to  novice 


Evolution 

—  Moved  from  data  to  context  centric 

User  Evaluated 

—  Validated  applied  CTA  concepts 

—  Validated  notional  designs 

—  Provided  additional  “expert’’  perspective 

Optimal  design  layout 

—  Resolved  competing  Novice/Expert 
needs 

—  Screen  real  estate  limits 

Data  research 

—  Determined  presentation  needs 

—  Integrated  disparate  sources  with  Expert 
Strategies 


Detailed  Design:  AMUG 


*  Identified  missing  Ul  features/functions 

*  Identified  unnecessary  features/functions 

*  Clarified  domain-specific  terms  and  jargon 

*  Confirmed  AMIT  findings  from  CTA/Lit  Review/Process 
Interviews 

*  Provided  cross-categorical  perspectives  (different  bases, 
weapon  systems) 
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Current  Prototype  Ul 


Prompt  for  Knowledge  Capture 


•Problem  to 
Resolution  Tool 

•Capture  strategic 
knowledge 


Current  Prototype  Ul 

Knowledge-centric  Approach 


Strategic  Knowledge 
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Conclusions 


*  Ideal  maintenance  world  never  will  exist 

—  Technical  data  has  limitations 

•  Designed  by  engineers  based  on  ideal  conditions 
—  Maintainers  have  varied  experience  levels 

•  Impossible  to  know  all  possible/potential  faults  &  causes 

*  Capture  and  reuse  expert  knowledge  and  strategies 

—  Combined  knowledge  base  to  aid  technicians 

•  Reduced  preparation  time 

•  More  first-time  success  repairs 

•  Accelerated  knowledge  &  skill  progression 

—  Supplement  TO  data  with  maintainer  experience 
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Questions  &  Answers 
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The  AMIT  program  is  an  advanced  research  (6.3)  program  developed  as 
a  human  performance  enhancement  for  flightline  maintenance 
technicians  in  the  operational  and  warfighting  environment. 


The  need  for  AMIT  was  identified  as  critical  to  reducing  persistent 
“Cannot  Duplicate”,  “Re-test  OK”  and  false  removal  patterns  that  have 
hampered  maintenance  performance  and  readiness  and  have  increased 
operating  costs. 


The  significance  of  AMIT  will  be  in  researching  the  troubleshooting 
process  and  cognitive  demands  and  decision  points  in  order  to  identify 
the  gaps  where  emerging  science  and  technology  could  be  applied  to 
improve  performance. 


